KEK-TH-1345 
UWO-TH-09/18 

Dynamical electroweak symmetry breaking with superheavy quarks 
and 2 + 1 composite Higgs model 

Michio HashimotcQ 
Theory Center, Institute of Particle and Nuclear Studies, 
High Energy Accelerator Research Organization (KEK), 
1-1 Oho, Tsukuba, Ibaraki 305-0801, Japan 

V.A. MiranskjQ 

Department of Applied Mathematics, 

University of Western Ontario, 
London, Ontario N6A 5B7, Canada 
(Dated: April 1, 2010) 

Recently, a new class of models describing the quark mass hierarchy has been introduced. In this 
class, while the t quark plays a minor role in electroweak symmetry breaking (EWSB), it is crucial 
in providing the quark mass hierarchy. In this paper, we analyze the dynamics of a particular 
^ , model in this class, in which the b' and t' quarks of the fourth family are mostly responsible 

for dynamical EWSB. The low energy effective theory in this model is derived. It has a clear 
signature, a 2 + 1 structure of composite Higgs doublets: two nearly degenerate ^f,/ ~ b' R{t' ,b')L 
and ~ i' fi{t' ,b')L, and a heavier top-Higgs resonance <I>t ~ ift,{t,b)L- The properties of these 
composites are described in detail, and it is shown that the model satisfies the electroweak precision 
data constraints. The signatures of these composites at the Large Hadron Collider are briefly 
discussed. 
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I. INTRODUCTION 



(N 

^ ' The dynamics of electroweak symmetry breaking (EWSB) and fcrmion (quark and lepton) mass hierarchy arc the 
, two central quests in the Large Hadron Collider (LHC) program. In particular, it is noticeable that the LHC has a 
*]0 ' potential for discovering the fourth fermion family [l| . The possibility of the existence of the latter has been studied 
. for a long time (for a review^see ReL Q). It is noticeable that the fourth family can play an important role in B-CP 
• ' asymmetries phenomena 0, Q ■ 
\ Since the mass bounds for the fourth family quarks t' and b' are of the order of the EWSB scale Q , the Pagels-Stokar 
(PS) formula @ suggests that their contributions to the EWSB should not be small. This leads to an idea of the 
dynamical EWSB scenario with the fourth family 0, Q , which is an alternative version of the top quark condensate 
model Because the Yukawa couplings of the t' and b' quarks have the Landau pole around several TeV scale, it 

suggests that the Higgs doublets $4/ ~ t' R{t' , &')i ^-^d ^ b' nit' , b')^ composed of them could be produced without 
fine tuning. 

^ ' Although the top quark mass is obviously near the EWSB scale, it apparently plays no leading role in the EWSB: the 
\ PS formula suggests that its contribution to the EWSB is around 10-20%. On the other hand, the t quark might play 
an important role in the dynamics responsible for the quark mass hierarchy. Recently, utilizing dynamics considered 
in Ref. [l^ quite time ago, we introduced a new class of models in which the top quark plays just such a role (T^]. The 
main two features of these models are a) the presence of strong (although subcritical) horizontal diagonal interactions 
for the t quark, and b) horizontal flavor-changing neutral interactions between different families. Together with the 
assumption that the dynamics primarily responsible for the EWSB leads to the mass spectrum of quarks with no 
(or weak) isospin violation, and with the masses of the order of the observed masses of the down-type quarks, these 
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features allow to reproduce the quark mass hierarchy and essential characteristics of the Cabibbo-Kobayashi-Maskawa 
(CKM) matrix [3. 

This approach can be implemented in the models with different EWSB scenarios. Its signature is the existence of 
an additional top-Higgs resonance doublet $4 composed of the quarks and antiquarks of the 3rd family, $t ^ tf((t, 
In the case of the dynamical EWSB scenario with the fourth family, the top-Higgs <i>t is heavier than the $t' and 
composites For simplicity, in Ref. we considered only the case when the <i>t mass is ultraheavy and it 
decouples from TeV dynamics. However, in general, this is not the case, and the $t can be detectable at the LHC. 
This leads to a model with three Higgs doublets. Actually, because the ${, ^ &)l composite, and those ones 
connected with the lighter c, s, u and d quarks, are necessarily ultraheavy and decouple in this scenario [ij], and 
because there is an approximate SU(2)]i4 symmetry between t'pj and 6'^ quarks, it would be appropriate to call it the 
2 + 1 composite Higgs model. In this paper, we will study such dynamics. 

As for the fourth family leptons, we assume that their masses are around 100 GeV and thus their contributions 
to the EWSB are smaller than that of the top quark. For the dynamics with very heavy fourth family leptons, and 
thereby with a lepton condensation, one needs to use, say, a five Higgs model. Also, the Majorana condensation of 
the right-handed neutrinos should be reanalyzed in that case. This possibility will be considered elsewhere. 

The paper is organized as follows. In Sec. [Hi we describe the model. The qualitative features of its low energy 
effective theory are discussed in Sec. IIIII In Sec. IIVI the results of the numerical analysis of the renormalization 
group equations are presented and the properties of the composite Higgs bosons are described. The structure of the 
CKM matrix and flavor-changing-neutral interactions are discussed in Sec. [V] In Sec. IVIl we summarize the main 
results of the paper. In Appendixes A-C, useful formulas used in the main text are derived. 



II. MODEL 



We will utilize a Nambu-Jona-Lasinio (NJL) type model to describe the dynamics with the 2 + 1 Higgs doublets 
composed of the third and fourth family quarks. Its Lagrangian density has the following form: 

C = Cg+Cf+CN.^L, (1) 

where Cg is the Lagrangian density for the Standard Model (SM) gauge bosons, the fermion kinetic term is 

£, ^ ^L^^L^ + E ^'P^ + E (2) 

1=3,4 i=3,4 i=3,4 

and the NJL interactions arc described by 

+G^,,,i^i*h'„){b'J,^^^r2i^{'^r) + GM^{'^t'j,){in^{'^) + Gfc,,(4=^)f«)(6'«Sr2(^i''V) + (h.c). (3) 

Here ^p'"^'^ denotes the weak doublet quarks from the i-th family, and u^' and c?^^ represent the right-handed up- and 
down- type quarks. 

write this theory in an equivi 

C = Cf+Cg+C^U., (4) 



It is useful to rewrite this theory in an equivalent form by introducing auxiliary fields, ^i^"^- 



where 
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with 



t' b' 



Af2 



M2 



(0) 



Gt'b' Gt't 
Gt'b' Gyt 
Gt't Gb't Gt 



(6) 



and = —ir2 ($[?■')*. The following remark is in order. If we added the Yukawa mixing terms, they could be 



erased by redefining the composite Higgs fields. For example, for the mixing term '0^'^-'ffl<i>|?'', 



the redefinition would 



be ip\ 



(0) 



(0) 



^t' ' 



(0) 



(0) 



Such non-unitary (but invertiblc) transformations arc allowed because there are 



no canonical kinetic terms for the auxiliary fields in C. 

As was shown in Ref. [l^, the diagonal parts of the NJL interactions, Gf, Gb' and Gt, can be generated from the 
topcolor interactions [lH. In this case, the scales for the dimensionful NJL parameters Gf ~ Gb' and Gt are connected 
with the coloron masses, A*^"*^) and A^f^, respectively. The mixing term Gft can be generated by a flavor-changing- 
neutral (FCN) interaction, t'-t-A^^*) [l3|. On the other hand, Gfb' may be connected with topcolor instantons [15[. 
In the 2 + 1 composite Higgs model, while the coupling constants Gf and Gb' are supercritical and responsible for 
EWSB, the t quark coupling Gt is subcritical, although also strong [l^ . 



As to the Gb't term, the situation is the following. As far as M^(o) 7^ and Af^ 



Nambu-Goldstonc (NG) bosons even if the M 



term, which is connected with G, 



b't- 



7^ 0, there do not appear 
is ignored. For example, 



assuming A/^(o)^(o) = 0, the Peccei-Quinn like U{1)a symmetry. 



/(3) 



(0) 



-249,4 (j) 



(3) 
L ' 

(0) 

t 5 



(0) 



4 ^ e^'^^t', 



2ie.4<j,(o) 



is explicitly broken by the Higgs mass mixing term M ^ 0. (Although the mixing term Af 

^*' ^1.' ^t' 



(7a) 
(7b) 

does not 



break this U{1)a symmetry, it is important: if both A^^(o)^(o) 9'iid Af^^oj^^o) equal zero, a new global U{1) symmetry 



appears.) Therefore, it is safe to take A^^(o)^(o) 
terms in a general discussion for a while, they will be ignored in the numerical analysis 



0. Because of that, although we will keep the Gb't and M\a) m 



III. DYNAMICS IN THE LOW ENERGY EFFECTIVE MODEL: QUALITATIVE FEATURES 

The model introduced in the previous section provides an approximate 2 + 1 structure in the Higgs quartic coupling 
sector in the low energy effective action. Indeed, in the bubble approximation, while the top-Higgs $t couples only 
to ijjf^ and in, the composite ^t'(b') couples only to V'/f'' and ^^(fo'fl), that leads to such a 2 + 1 structure. When we 
turn on the electroweak gauge interactions, this structure breaks down. The breaking effects are however suppressed, 
because the Yukawa couplings are much larger than the electroweak gauge ones. 

In this section, we analyze the main characteristics of the 2 + 1 low energy effective Higgs model, in particular, the 
structure of its vacuum expectation values (VEV). We also discuss the relations between the parameters of the initial 
NJL model (such as the NJL couplings, etc.) and the observable ones. 

In order to illustrate main qualitative features of the effective model, we will employ the bubble approximation in 
calculating its parameters (such as Yukawa and quartic couplings, etc.). However, the structure of the action will be 
taken to be more general, based on a numerical analysis of the renormalization group equations (RGB's) with the 
compositeness conditions [ill, which is performed in the next section. 
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A. Low energy effective model 



Since at low energy the composite Higgs fields develop kinetic terms, the Lagrangian density of the low energy 
effective model is 



with 



and 



r 



C — Cf + Cg + Cs + Cy, 



(8) 
(9) 
(10) 



where V is the Higgs potential and '^t' ,b' ,t are the renormalized Higgs fields. Taking into account the renormalization 
group (RG) improved analysis, which will be presented in the next section, we study the following Higgs potential: 



with 



Vi = Ai($j;,$fcO' + A2($I,$t')' + A3($j,.$h')(*I'*t') + A4|$j;-$tf 



(11) 



(12) 



As (4**')' 



(h.c.) 



xM^tf .{12,) 



While M"^^^ and Af|^^ are negative, the mass square is positive, which reflects a subcritical dynamics of the 
t quark. The top-Higgs $t acquires a vacuum expectation value only due to its mixing with (as was already 
indicated above, we assume that its mixing with is negligible). 
The bubble approximation yields the following Yukawa couplings 



( N (A(3))2 



N , (A(4))2 
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-1/2 
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the Higgs mass terms. 





= yl 
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= yt'yb'Mlm.m, 

t' h' 






= yt'ytMl(o)^(o), 






= ytyb'Ml(o)^(o), 





and the Higgs quartic couplings. 



Ai=A2 = Y = — ^^^1'' A.5 = 0, 



(14) 
(15) 

(16) 

(17) 

(18) 
(19) 
(20) 
(21) 

(22) 
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At = y^ (23) 

where N{= 3) denotes the color number, /i is a renormaUzation scale, and A*^"^^'*^^) are the composite scales for the top 
and the fourth family quarks, respectively. For details, see Appendix [XI 

While the structure of the mass term part V2 is general for three Higgs doublet models, the V4 part is presented as 
the sum of the potential for the two Higgs doublets $t' and and that for the doublet $t, i.e., it reflects the 2 + 1 
structure of the present model. For the most general three Higgs potential, see Appendix [B] 

As far as we ignore the electroweak (EW) gauge interactions, the terms breaking the (2 + 1)-Higgs structure, such 
as ($(,$t/)($J<i>t), are not generated by the one-loop diagrams. The (2 + 1)-Higgs approximation should work well 
even in the numerical analysis: We expect that the errors connected with this approximation is at most around few 
%, and hence they are less than a 10% level uncertainty of nonperturbative effects, which will be discussed in the 
next section. Note that while the l/7V-leading approximation, including the QCD effects, is qualitatively reasonable, 
it is not good quantitatively, with errors around 30% level. 

In passing, because the NJL model is used, eight-Fermi interactions, such as are ignored in the 

present approach. This point is also important for keeping the (2 + 1)-Higgs structure. 



B. The structure of the vacuum expectation values 



Let us analyze the VEV structure and the mass spectrum of the fourth family quarks and the Higgs bosons. 
We define the components of the Higgs fields by 

<I>.= f^^""+'5-^^"M, (24) 



where X = b',t',t. Note that the relation 

v^^vl+v^,+vl (25) 
holds, where v ~246 GeV. It is convenient to introduce the ratio of VEVs, 

tan/34=— , tan/334 = ^* (26) 

i.e., 

Vb' = VCOS/34COS/334, (27) 

Vf = wsin/34COS/334, (28) 

vt = wsin/334. (29) 

The notations S/j^ = sin/34, 5^3^ = sin/334, etc., will be used. The quark masses are (compare with Eq. pU|): 

rribi = ^yb'i^i = rub'), (30) 

mt' = ^ yt'(Ai = mt'), (31) 

rrit = ^yt{n = rrit) . (32) 

Since we expect A*^^^ ^ A^^\ the Yukawa couplings are almost the same, 2/t'(/^ — mf) ~ yb'{^J■ — "m-b') ^ yt(M — ^t)- 
The T-parameter constraint suggests that me ~ mf,' is favorable, so that the phcnomenological condition mf ~ 
TTT-b' ^ iTT't requires Vt' — Vb' ^ ft, i.e., 

tan/34 ~ 1, tan/334 < 1 . (33) 
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To obtain tan/334 < 1, the subcritical dynamics for the t quark, leading to > 0, is crucial [l^ . 

Let us analyze the VEV structure and how we can obtain the desirable solution. The effective potential expressed 
through the VEVs is given by 



} o J t X t o b t T- 

+ ^Ai4 + + |(A3 + A4 + A5)44 + l^tvf, 



so that the stationary conditions are 
dV,s 



dvb' 

dvf 
dVos 
dvt 



Ml^,Vb- + Ml^^^^vt- + Ml^,^^vt + Xivl + - (A3 + A4 + \5)vb'vl = 0, 
Ml^,vt' + M|^,$^,fh' + Ml^,^vt + \2vl + i(A3 + A4 + A5)ut'4 = 0> 
Mlvt + Ml^vt, + Ml^Vb- + Xtvf = . 



In order to obtain the approximate solution with Vf — Vb' ^ vt , we assume 



\Ml, 



\Ml,\>^\M? 

' Vt 



'S>t'<S't 



Vb' 



M. 



These assumptions are easily satisfied in our dynamical model. If we further impose 



and 

the solution is approximately given by 

1 



Ai + - (A3 + A4 + A5)tan^/34 
A2 + ^(A3 + A4 + A5)cot2/34 



-Ml 



m|^,$^, tan/34, 



^A/| -Ml $ cot/34, 



Vt 



Ml 



Vf 



M2 



-Vb' 



(34) 

(35) 
(36) 
(37) 

(38) 

(39) 
(40) 

(41) 
(42) 
(43) 



The last equation essentially determines tan f3; 



34- 



C. Mass spectrum of the Higgs bosons 



We now analyze the mass spectrum of the Higgs bosons. 

The formulas for the masses of the CP even Higgs bosons are quite complicated, because they are the eigenvalues 
of the 3x3 matrices. Even for the CP odd and charged Higgs bosons, the mass formulas are still not quite simple (for 
the analytic formulas, see Appendix [C]) . In order to make the physical meaning of the dynamics more transparent, 
here we will consider approximate and useful expressions. 

The T-parameter constraint suggests tan/34 ~ 1. At the zeroth approximation, we may take exactly tan/34 = 1. As 
was pointed out in Sec. [TTl we may further assume M|^^^^ « 0. We also find A5 = (see Sec. IIIIAI above). 

The mass of the charged top-Higgs boson, which mainly couples to the top and bottom, should be constrained by 
Rb and, therefore, should be rather heavy. We thus conclude that each of the heaviest CP even, CP odd and charged 
Higgs bosons are mainly provided by the top-Higgs doublet $t. 
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Then the mass eigenvalues are approximately given by 



Ml^ ~ -2M2 ^^,(l-tan2/334), (44) 



Ml^ ~ (1 + 2 tan2/?34)+Ml^tan2/334, (45) 
il4± Ml^ - ^A4z;2c2^, (1 - tan^ p^^), (46) 
^ Ml^-iAV4,, (47) 

up to ©(tan^ Pza)- Here for the CP odd Higgs bosons and for the charged Higgs bosons, we defined Ma^ < Ma^ and 
M^± < M^± , respectively. For the CP even Higgs bosons, we defined Mh^ < < ■ As was indicated above, 

the heavy Higgs bosons, H^,A2, and H^, consist mainly of the components of the top- Higgs $t. 
The stationary condition (|43p approximately read 

— ^«y2tan/?34, (48) 

where we took M^^^^^ = 0. By using Eq. ([22]), Eqs. (I44l)-(|47l), '!;^c§4 = Dj, + v^, , and -A4Uj^,(j,j ^'^'t'{b') ™ 
bubble approximation, we also find the charged Higgs masses as 

« Ml^+2(m,2, +m2,)(l-tan2/334), (49) 
w +2(m2, +mg,)tan2/334. (50) 

The upper bound of Ma^ for a given value of is discussed in Appendix [Cl 

There are eight parameters in the initial NJL model: six NJL couplings and two composite scales, A'^^"'). As we 
discussed above, these parameters are closely connected with physical observables. The values of A^^^^^^ determine the 
Yukawa couplings. Then, by using the experimental value of nit, we can find Wf. Fixing the value of tan/34, we can 
determine Vf and Vf through Eq. (j25p . and thereby can express me and nif,' through the Yukawa couplings. The 
masses M|^^^^^ and are connected with M\_^ and M\^, respectively. The value oi M^^^^JM^^ is approximately 

given by Vt/vt', if we assume M|^^^^ « 0, as we already did. 

In summary, it is convenient to take the following eight parameters instead of the original theoretical ones: 

w(= 246 GeV), mt(= 171.2 GeV), tan/34(^ 1), Ma„ Ma,, A'^), A^^), M|^,^^(«0). (51) 

In the next section, we will perform a numerical analysis. 



IV. NUMERICAL ANALYSIS 



The analysis in the previous section was somewhat schematic. In this section, in order to describe the dynamics in 
the model more precisely, we will employ the RGE's with the compositencss conditions [HI, H^: 



2/f,(/x = AW)=oo, 2/,Mm = AW) 



y?(M = A(3)) 



(52) 



and 



hi 



= ^ 

' 4 



0, 



=A(i) 



Vb'V?' 



= 0, 



=A('4) 



A4 



9 9 



^0, h 

^=A(4) Vt 



=A(3) 



(53) 



The RGE's are similar to those for the two Higgs doublet model (THDM) type II For consistency with the 
(2-|-l)-Higgs structure, we ignore the one-loop effects of the EW interactions, which should be tiny. On the other hand, 
although the Higgs loop effects are of the 1/iV-subleading order, we incorporate them, because they are numerically 
relevant. 
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The RGE for the QCD couphng is given by 

(16^2)^|.^3 = -C35I, C3 = 11 - ^Ng, (54) 

where Ng denotes the number of generations (families). The RGB's for Yukawa couplings are 

d 9 1 

(167r^)/^^2/6' = -^alvb' + ^Vb' + -^yt'Vb' , (55a) 

(i6^')M^yt' = -»ght' + ly?' + lylyt', (55b) 

(16^2)^|.^^ ^ ^Sgly^ + lyl (55c) 

where we ignored the bottom Yukawa coupling yt and the EW loop effects in order to keep the (2 + 1)-Higgs structure. 
On the other hand, the RGB's for the Higgs quartic self-couplings are 

il6TT^)fi^Xi^ 24X1 + 2X1 + 2X3Xi + Xl + UXiyl -6yl, (56) 

(167r2)^AA2= 2AXl + 2X1 + 2X3Xi + Xl + 12X2yf, -6yf,, (57) 

(167r2)^AA3 = 2(Ai + A2)(6A3 + 2A4) + 4X1 + 2A^ + 6A3(y2 + y^,) - 12ylyf,, (58) 

(167r2)^AA4 = 4(Ai + A2)A4 + 4(2A3 + A4)A4 + 6A4(yg, + y^,) + Uy^yl, (59) 

(IBtt^)^— A5- As 4(Ai+A2)+8A3 + 12A4 + 6(j/2, +y2) , (60) 

^lQ^^)^^Xt = 24A2 + 12Aty2 _ 6yf , (61) 



where we ignored the BW loop effects. Note that the coupling constants Ai and A2 that we use are twice larger than 
those in Ref. In our model, we find A5 ~ 0. 

Since we impose the same compositeness condition for i' and fo', and because the RGB's for yt' and yb' are the same, 
the SU(2)ji4 symmetry, which is the symmetry between i'^ and 6^, is exact for both the Yukawa and Higgs quartic 
couplings, as far as the EW interactions are ignored. The SU{2)h4 breaking effects appear only from the Higgs mass 
mixing terms. This leads to vt' 7^ Vb' in general, and thereby the mass difference between the t' and 6' quarks can 
arise. 

For the numerical calculations, we vary Ma^: Ma2, A'^^\ tan/34, and, as an input, use v = 246 GeV and 

the MS-mass rrit = 161.8 GeV. The latter corresponds to the pole mass Mt = 171.2 GeV We also use the QCD 
coupling constant a3{PIz) = 0.1176 @. As for M|^^^^, we fix A/|^^^^ = 0. Numerically, it is consistent with Gb't ~ 0. 

The results are illustrated in Figs. [TH31 The masses of f and b' are essentially determined by the value of A^^^ 
where we converted the MS-masses mf and mf,' to the on-shell ones, Mt,(b') = Tnt'{b')[^ + 4as/(37r)]. As is seen in 
Fig. [1] their dependence on k'^^^ K''^\= 1 — 2) is mild. When we vary tan/34 in the interval 0.9-1.1, the variations of 
Mf and Mb' are up to 10% (see Fig.[T]). 

The Higgs masses are sensitive to the value of A^''^ (see Fig. [2]), while their sensitivity to A('^YA^^^(= 1 — 2) is low. 
Note also that the Higgs mass dependence on tan/34 is mild, at most 5% for tan/34 = 0.9-1.1, A'^'^^ = 2-10 TeV, and 
A(3)/A(4) = 1.5. 

It is noticeable that the masses of the and H^, Higgs bosons are close and correlate with the mass of the A2 
boson, as shown in Fig. [31 This point agrees with that we identified these heaviest bosons mostly with the top-Higgs 
doublet $<: it reflects a subcritical dynamics of the t quark. Last but not least. Figs. [Hand [3] clearly illustrate the 2 
+ 1 structure of the model. 

Since at the compositeness scale the Yukawa couplings go to infinity, there could in principle be uncontrollable 
nonperturbative effects. In order to estimate them, we studied the RGB's with relaxed compositeness conditions: 

y?,(M = A(^))-yi, yl{^i = K^'^) = yl, y^{pi^M'^) = yl yi < 00 . (62) 
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a'"^' (TeV) 



A<^) (TeV) 



FIG. 1: Afj/ and M;,/. The bold and dashed curves are for A'-'^'/A'*-' = 1,2, respectively. The dotted lines correspond to the 
lower bounds for the masses of t' and b' at 95% C.L., Mt' > 311 GeV and AU' > 325 GeV [3. 



For concreteness, we took = 25. It was found that such nonperturbative effects are around 0(10 %), while the 
loop effects of the EW interactions are expected to be at most ©(few %). In fact, the sensitivity of Mt' and Mb/ on 
yl is 20%~10% for A^^) = 2-10 TeV. On the other hand, the mass Afe, of the Hi Higgs boson varies about 20% for 
A^"') = 2-10 TeV, while the sensitivity of the masses of other Higgs bosons is at most 5%. Taking into account these 
uncertainties, one can safely ignore the EW one-loop corrections. 

Since the two charged Higgs bosons couple to t and b quarks, their masses arc severely constrained by Rh. Moreover, 
because in our model M^± arc determined by 2j it leads to a constraint for Ma-^ a- The 2(T-bound of Ri, yields 

Ma^ > 0.70,0.58,0.50 TeV for A^ = 2,5,10 TeV, A(3)/A(4) = 1.5, and Ma, > 0.1 TeV. We note that the above 
constraint for M^^ is not very sensitive to the values of Ma, and A^^'^ /A^'^\ 

The S and T parameters for a multiple Higgs doublet model are analyzed in Ref. [l^. In our model, the Higgs 
contributions are Sh = 0-0.1 and Tf, = -0.02- - 0.2 for A^*) = 2-10 TeV, A(3)/A(4) = 1 - 2, 0.1 < Ma, < 0.6 TeV, 
and 0.5 < Ma2 < 0.8 TeV. Since the Higgs contribution to the T-paramcter is slightly negative, the mass differences 
of the fermions, depending on the values of T^, are allowed. For example, following the {S,T) analysis a la LEP 
EWWG [l^l, we found that our model is within the 95% C.L. contour of the {S, T) constraint, when the fourth family 
lepton masses are Mt' — M^' ~ 150 GeV. 

A noticeable feature of the presence of the fourth family is that because of the extra loop contributions of t' and 
6', the lightest CP even Higgs boson production via the gluon fusion is considerably enhanced. For example, for 
A(4) = 3 TeV, A(3)/A(4) = 1.5, tan/34 = 1, Ma, = 0.50 TeV, and Ma^ = 0.80 TcV, we obtain Mf = M^ = 0.33 TeV 
and AIh, = 0.49 TeV. In this case, the enhancement factor of (Tgg_i./fjBr(i7i ZZ) to the SM value is 5.1, where 
the relative HiZZ and Hiti couplings to the SM values are 0.86 and 2.0, respectively. Similarly, the CP odd Higgs 
production via the gluon fusion should be also enhanced, compared with gg ^ A 'm the two Higgs doublet model. 
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FIG. 2: Mass spectrum of the Higgs bosons for A'*' = 2, 3 TeV . We took A^^^ /A^"^ = 1.5 and tan/34 = 1. = 800 GeV is 
the input. The 2 + 1 structure in the model is clearly manifested. 



CKM STRUCTURE AND FLAVOR CHANGING NEUTRAL CURRENT PROCESSES 



We use the same approach to constructing the CKM matrix as in Rcf. [lj| . The Yukawa interactions take the form 



(63) 



where 



72 

Yd ^ —Md, Yu = — 

Vb' Vf 



Mr, 



(64) 



and 



M 



D 



( rud £,i2'md £,izmd Cw^d 
V C4iTOd C42ms Usrris mb' 



(65) 



m„ 7712^1, r]i3mu rjum^ 

^ ' ryaiTOti '732mc ryssWc 7?34TOc ' ' 
?74im„ 7742^^ 7743TOC "It' 



In accordance with the essence of the composite (2 + 1)-Higgs model, we assumed that the top-Higgs is responsible 
for the top mass. 
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FIG. 3: Mass spectrum of the Higgs bosons for A'*' = 2.5 TeV . We took A'^Va'*' = 1.5 and tan/34 = 1. The CP odd Higgs 
masses Ma2 ~ 800, 700 GeV are also the inputs. The 2 + 1 structure in the model is clearly manifested. 



The CKM matrix is approximately given by 



T/4x4 
^CKM 



^r^TOa 2 V "la / ^'^•^ mt '■^•^ nit ' ' 



* "Ic C* "Id "Ic „* "Ic 1 

\ '?24;;r;7 ?i2;;r7 ^2^7^ ^34:7^ / 

(67) 

Notice that 7na/ms 0.1 = 0(Ks), m^/mb - 0.01 = 0{Vcb), m^/mt 0.01, and md/mb - 0.001 = ©(Kf,)- Thus 
we can reproduce the CKM structure by taking S^ij = C(l). Since the mixing between the fourth family and the 
others is suppressed, \Vtid\ \Vus\'m.c/mf ^ 0(10"^) and |Vt's| ~ \Vt'b\ ~ mc/mt' ~ C(10~^), the contribution of 
the flavor-changing-neutral-current (FCNC) processes with the fourth family quarks in the B-system is negligible: 
"^t'l^t'd^t'bP ~ iKsP^^c/"^*' for Bd and ml,\V^, ^Vt'b\'^ ~ mt/ml, for Bs- Similarly, 6 ^ S7 and Z ^ bb via the 
t'-loop are also suppressed (for a related discussion, see Ref. [iJI). As to the contribution of a box diagram with f in 
the AS* = 2 processes in the K system, it is very small due to TOj, |Vf*^14'sP ~ rn'^\Vus\'^rn1/m'^,. Note also that the 
contributions of the charged Higgs bosons are negligible, because their masses are relatively heavy and the mixing 
angles are small. 

On the other hand, a new tree FCNC term appears in the up-quark sector, so that the D'^-D^ mixing is potentially 
dangerous. Let us estimate this effect. In the basis of the fermion mass eigenstates Ul,r and D^ fj, corresponding 
to the left and right-handed up-type quarks and the down-type ones, respectively, there appear the tree FCNC and 
flavor-changing-charged-current (FCCC) terms in the Higgs sector: 

/:fcnc/fccc = ~ — ULMUR{ht, - tzt>) + —tJLMURiht - izt) + (h.c.) 

Vt' Vt 

+V2^URM^V^^t,DLu;+ - V2'^UrM^V^^^Dlu;+ + (h.c), (68) 
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where the fields ht'^t, zt\t, and ujf; ^ are defined in Eq. ([24)) . The matrix M is 



where 









1 


^2^ 


'^•^ rrit 










''12 


1 




^24^ 








^ ^/l 2^/23)1^ 


^23 


1 


^34^ 




v 




-^t2%*4)7;r7 


^24 m^, 


~%4 


1 / 



(69) 



(70) 



and 



U 



R 



1 



-iV31 
-('?41 



71* Hie 

'32 mt 

1 



''43 m„ 



1 



(71) 



1 

''?21 — 
-??21??32)^ 

-??2l'?42)f^ -V42^ -143; 

are the transformation matrices from the weak basis to the mass eigenstates one for up- type quarks. The dangerous 
contributions to the D'^-D'^ mixing come from the u-c-hf^t couphngs and thus they are proportional to 

^ mt niu rric 

J- u—c—hf/ f — ■ 

vt',t mt mt 

Therefore the corresponding contribution to the D^-D^ mixing parameter Am/^/TriD is of order 



(72) 



-c-h 



ML 



fl 

Mfr 



X 0(10" 



-14\ 



(73) 



where fo is the D meson decay constant, Bd denotes the B parameter, and we ignored the mixing between hf^t 
and i?i,2,3- Since the experimental value of the D^-D^ mixing parameter is AruD/mD ~ 0(10^"'^'*) Q and fo ~ 
O(lOOMeV), this tree FCNC contribution is negligible for 3 of the order of the EWSB scale. Due to the same 
reasons, the tree FCCC contribution is also suppressed in the first and second families. 



VI. CONCLUSION 

The 2 + 1 composite Higgs model is an offspring of the top quark condensate one f9l-[ll{ but has much richer and 
more sophisticated dynamics. As a result, this allows to describe rather naturally both the quark mass hierarchy [l3| 
and EWSB. It is quite nontrivial that this model passes the electroweak precision data constraints. Besides, we can 
naturally evade the constraint of Z — >■ bb, because the top-Higgs is sufficiently heavy. 

It is also noticeable that the model has a clear signature: the 2+1 structure of the composite Higgs bosons. In 
the heaviest doublet, the top-Higgs $t ~ i/?(t, &)l component dominates. As is clearly illustrated by Figs. [2]and|3l 
the masses of the four resonances in this doublet are nearly degenerate that reflects a subcritical dynamics of the t 
quark. 

Other phenomenological manifestations of the model are the following. The gluon-fusion channel with a decay to 
two Z bosons should be essentially enhanced. For example, for the parameter set with A'"*-* = 3 TeV, A'^^/A*^^^ = 1.5, 
tan ^4 = 1, Ma, = 0.50 TeV, and M^, = 0.80 TeV (which yields Mf = Mb' = 0.33 TeV and Mh, = 0.49 TeV), the 
enhancement factor of (Tgg^.i/jBr(7Ji — >■ ZZ) to the SM value is 5.1. Similarly, the CP odd Higgs production via the 
gluon fusion should be enhanced as well, compared with a three family model. Also, multiple Higgs bosons may be 
observed as tt resonances at the LHC [221. Detailed analysis of their LHC signatures will be performed elsewhere. 
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Appendix A: Bubble approximation 

111 the bubble approximation, i.e., the l/A'^-leading approximation neglecting the QCD effects, we 
the low energy effective theory; 



with 



C ~ Cf + Cg + Cs + Cy, 



- r 



y,4{'^M^^,^^,^''^> + yt^["tii<t>t + (h.c.) 



.,(4) 



(3), 



and 



V = V2 + Vi, 

14 = >^tv{Ml^,^^M^^,^^,f + ]-\MMlM^,f, 



where we have already renormalizcd the composite scalar fields and also defined 2x2 Higgs fields, 
and the right-handed doublet 



Note that 

The renormalizcd quantities are given by 



N , (A(4))2 
In 7^ — 



167r2 



-1/2 



can easily obtain 
(Al) 

(A2) 
(A3) 

(A4) 

(A5) 
(A6) 

(A7) 
(A8) 
(A9) 

(AlO) 





/ N (A(3))2\-'/' 
1^16^' ) 




(All) 


Mi,(M) 


= yl 


/4.„-^((aW)^ 




(A12) 




= yl 






(A13) 




= 






(A14) 




= yt'yt'Ml,^^^,^, 




(A15) 








(A16) 




= ytyvMl^,^^^^, 




(A17) 


A 








(A18) 


At 


= yl 






(A19) 
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The part of V4 has the global symmetry, 

5f/(2)L4 X 5[/(2)fl4 X SU{2)Lt x SU{2)Rt x U{1)a, (A20) 
where the transformation property is 

A^*,,*,, ^ 5L4X4.,,<E.,,gl?4: M^,~^ gLtM^,g^J^^, (A21) 

with € 5'C/(2)i4, 5i^4 e SU{2)ii4, g^t G SU{2)Lt and g^jt S SU{2)pit- The hypercharge ?7(l)y is included in the 
f/(l) parts of SU{2)Ri and 5'C/(2)iit, ' 

->7W$^, 4,^,6-'*'^^, ^X4,,e"*^^*, (A22) 

and the U{1)a corresponds to 

^ 7W$^,$^,e-2i«-^, ^ _^^^g-2ze^r3 _ (A23) 

Beyond the bubble approximation, another SU{2)pj/^ symmetric coupling, A[tr(A^jj, ^^^^ )]^, is generated at 

low energy. This is the reason why we consider more general expressions in Sec. IIIIl 

Since there is no bottom Yukawa coupling, the SU{2)p(i symmetry is explicitly broken down in the Yukawa sector. 
Moreover, the Higgs mass mixing terms V2 respect only the SU{2)l x U{1)y gauge symmetry. Thus the Higgs mass 
spectrum does not have the SU{2)fji and SU{2)fit symmetries in general. 



Appendix B: General three Higgs doublet renormalizable model 



Let us consider a potential of a general three Higgs doublet renormalizable model with the scalars 0i,2,3- 
The most general potential is 

where the mass terms, 

V2 = TOic/il^i + ml(f)l(f>2 + + [™i2<?^l'/'2 + (h-c)] + [m\^(j)\(t)^ + (h.c) 

and the quartic couplings. 



+ All22(4<?!>l)(4^2) + A2233(4^2)(4<?!>3) + A33II (4<?!>3 ) (^1 ^1 ) 
+ Al22l|0l^2p + A2332|9i'2'/'3P + A3113 |(/)3(/)l ^ 

+ [\l2l2{4>\4>2f + (h.c)] + [A2323(4'/'3)^ + (h.c)] + [A313I (4</>l ] 



(h.c)] 



+ [Alll2(^l0l)(402) 
+ [A222l(402)(40l) 
+ [A333l(4<^3)(4</'l) 
+ [All23(</'l0l)(403) 
+ [A2213(4</'2)(403) 



A3312(0303)(0l0: 



(h.c; 
(h.c; 
(h.c; 
(h.c; 
(h.c; 
(h.c; 



+ [Aiii3(</>l0i)('/'l03) + (h.c 

+ [A2223(4'^2)(4</'3) + (h.c 
+ [A3332(4<^3)(4^2) + (h 
+ [Ai213(</'l02)(<^l03) + (h 
+ [A2123(4</'l)(403) + (h 
+ [A3132(</'^0l)(<^^02) + (h 



[Al23l(4</'2)(4'^l) 
[A2132(4</'l)(4'^2) 
[A3123(40l)(4'^3) 



(h.c)]. 



(h.c)] 
(h.c)] 
(h.c)]. 



For the mass terms, the number of the real parameters is 

Nm = Nfj - 



{Nh - 1) : 



(Bl) 



(B2) 



(B3) 
(B4) 
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where Nh denotes the number of the Higgs doublets and we used the rephasing degrees of freedom of the Higgs fields. 
For the quartic couplings, the number of the real parameters is 

Nq = + 1) . (B5) 



In particular, the formula for the two and three Higgs doublets yields 10 and 45, which agree with expressions (|B2p 
and (jB3P above. 

The RGB's for the multi-Higgs models are discussed in Ref. [2l|. The S and T parameters for the multi Higgs 
doublet model are analyzed in Ref. [l9{ . 

Appendix C: Analytic mass formulas for Mai 2 and Af^± 

Let us define the mixing angles of the CP odd and charged Higgs fields, 

where tt^ and tt^ denote the would-be NG bosons eaten by the weak bosons. The mass eigenvalues of the corresponding 
Higgs mass matrices are Mai 2 ^-nd M^± . 

Eliminating M"^^^ , Af|^, and by using the stationary conditions, we obtain the mass eigenvalues of the CP odd 
and charged Higgs bosons: 

\ S/34C,34 S^^S^3,C^3^ '^^^ '''' '"^ C;34S/334C/334 / 

+7^ (m|,,*,c/^4 - Ml^,^^sS , (C3) 

/334 



and 



*t'*6' , ^"*t'*t ,2 ,2 2 N , ^"*6'*t / 2 , „2 2 \ ^ \ „.2„2 _ 7i,,f2 



71 r2 ^ *t'*6' I --Vj/Vt ^2 , 2 2 \ , •i'b'i't / 2 ,2 2\ ^\22-^7i.r2 



(C4) 



2 \'? / -^^l,/** / 2 2 2 \ ^'^'^y^t I 2 2 2 \ 1x22 

i± F7± ' ^ — + —^{slcl - sl) + -^{slsi - cl) - izXiV^cl 

\ Sp.Cp, Sp,S0,,Cf3,,' C;34S/334C/334 ^' 2 
4 \2 



2 



4 / \ 
— (A/|^,$^C/34 - ^'4,,** 5/34) • (C5) 



C/3: 



Although in principle the analytic formulas for the mass eigenvalues of the CP even Higgs can be derived, they are 
too complicated and, therefore, not very useful. 

For M|^^^^ = 0, the upper bound of Ma^ for a given M^^ is obtained as 



< 1 + 2 cot^ Pi sin^ /334 - 2 cot Pi sin Pzi\^ \ + cot^ ^4 sin^ /334 < 1 , (C6) 



where the equality on the right hand side satisfies only when cot P^ sin P^a — (by definition, Mai < Ma2 
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The mixing matrices are defined by 
with 

Vb' ve_ t^X"^ 



fVb' Vf Vt 

Uy = 

\ V V V 



COS /34 COS /334 

sin /34 COS /334 
sin ^34 



(C7) 
(C8) 
(C9) 



where X = A,H^, 



ei 





cos rjxGi — 


= 


sinTyxGi + ( 


/ — sin /?4 




cos /34 


).,.{ 


V 






(CIO) 
(Cll) 



(C12) 



and 



tan?7x = , 

P 



The approximate expressions 

/ J_ / -, _ tan'' /j34 
' V2 V 2 



K- = 1-/1/2 -2^ _ m2 

*;934 



dons for the mixing matrices are: 



2 



71 (1 



2 



V 



tan /334 



Mi, 



3 t.an^ ff34 A 

I tan ^34 



g/34 \ 

^^tan/334 



A2 



-%/2( 1+ 2^jtan/334 
1 — tan2 /334 



and 



( J_ (t _ tan^ ,334 ' 
V2 2 



1 

V2 



tan^ ,334 ' 



tan^ /334 
2 



3 tan'' ^34 
2 



tan ;334 



-V2( 1+2^ ltan/334 



V 



tan Pzi 



up 



tan /334 

to C'(tan2/334), 0{lKi^h^M\jM\^ and 0{tSin ^s^M^^ /Mf 



1 — tan2 /334 



^2 



(C13) 

(C14) 
(C15) 



(C16) 



(C17) 
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